WEAK KAM THEORETIC ASPECTS 
FOR NONREGULAR COMMUTING HAMILTONIANS 



ANDREA DAVINI AND MAXIME ZAVIDOVIQUE 

Abstract. In this paper we consider the notion of commutation for a pair of 
continuous and convex Hamiltonians, given in terms of commutation of their Lax- 
Oleinik semigroups. This is equivalent to the solvability of an associated multi- 
time Hamilton-Jacobi equation. We examine the weak KAM theoretic aspects 
of the commutation property and show that the two Elamiltonians have the same 
weak KAM solutions and the same Aubry set, thus generalizing a result recently 
obtained by the second author for Tonelli Hamiltonians. We make a further step 
by proving that the Hamiltonians admit a common critical subsolution, strict 
outside their Aubry set. This subsolution can be taken of class C^'^ in the Tonelli 
case. To prove our main results in full generality, it is crucial to establish suitable 
differentiability properties of the critical subsolutions on the Aubry set. These 
latter results are new in the purely continuous case and of independent interest. 



1. Introduction 

In the last decades, the study of Hamiltonian systems has been impacted by a 
few new tools and methods. For general Hamiltonians, the framework of symplectic 
geometry led Gromov to his non-squeezing lemma [32j, which gave rise to the key 
notion of symplectic capacity, now uniformly used in the field. 

In the particular case of Tonelli (smooth, strictly convex, superlinear) Hamiltoni- 
ans, some variational techniques led to significant improvements and results. John 
Mather led the way in this direction in \4:0\ I41j . In the first paper he studied free 
time minimizers of the Lagrangian action functional, introducing the Aubry set, 
while in the second one he studied invariant minimizing measures, introducing what 
is now called the Mather set. 

Later Fathi, through his weak KAM Theorem and Theory, showed the link be- 
tween the variational sets introduced by Mather and the Hamilton-Jacobi equation. 
This allowed to simplify some proofs of Mather and to establish new PDF results, 
in connection with the theory of homogenization |38j . This material is presented in 
[28]. 

The main challenge now seems to find analogues of the Aubry-Mather theory in 
wider settings. There are mainly two approaches to this problem. The first one is 
to lower the regularity of the Hamiltonians. This is a rather natural issue in view of 
applicability to Optimal Control and Hamilton-Jacobi equations. A generalization 
of the weak KAM theory to continuous and quasi-convex Hamiltonians was first 
given by Fathi and Siconolfi in [3T]. Their approach has been subsequently developed 
and applied in different contexts, see for instance p^[23l[2ll[25|[S6|[3nl[H3|[Ml[36| 

Egiii]. 
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The second is to drop the convexity and coercivity assumptions, thus preventing 
from using traditional variational arguments. A generalization of weak KAM Theory 
to this framework is an outstanding and widely open question. On the other hand, 
the theory of viscosity solutions, introduced by Crandall and Lions |19j . provides 
powerful tools to study Hamilton-Jacobi equations in broad generality. With regard 
to the problems studied in the references above mentioned, these techniques have 
been successfully employed to obtain similar results under different, and in some 
cases weaker, assumptions on the Hamiltonians, see for instance [2t [5l [6l [71 [T5]. 

The present paper is addressed to explore the weak KAM theoretic aspects of 
commuting Hamiltonians. This issue is related to the solvability of a multi-time 
Hamilton-Jacobi equation of the kind 

'dtu + H{x, D^u) = in (0, +oo) x (0, +oo) x M 

< dsU + G{x,D^u) = in (0, +oo) X (0, +oo) X M (1) 

^n(0, 0, x) = no(x) on M, 

where M stands either for the Euclidean space or the A^-dimensional flat torus 
T^, H and G denote two real valued functions on M x R^, and : M — )■ M is any 
given Lipschitz continuous initial datum. 

The first existence and uniqueness results appeared in [39J for Tonelli Hamilto- 
nians independent of x via a representation formula for solutions of the Hamilton- 
Jacobi equation: the Hopf-Lax formula. Related problems were studied in [35]. 

A generalization of this result came much later in [8], where dependance in x 
is introduced (and the convexity hypothesis is kept). As a counterpart, the au- 
thors explain the necessity to impose the following commutation property on the 
Hamiltonians: 

{D^G, DpH) - {D^H, DpG) =0 in M x M^. (2) 

Note that this condition is automatically satisfied when the Hamiltonians are in- 
dependent of X. The proof involves an a priori different Hamilton-Jacobi equation 
with parameters and makes use of fine viscosity solution techniques. In [46], un- 
der stronger hypotheses, a more geometrical proof, following the original idea of 
Lions-Rochet, is given. 

This equation was then studied under weaker regularity assumptions in [42] . The 
convexity is dropped in |16j in the framework of symplectic geometry and variational 
solutions. Finally, let us mention that in |45j the infiuence of first integrals (not 
necessarily of Tonelli type) on the dynamics of a Tonelli Hamiltonian is studied. 

In [36] the second author has explored relation ([2|) for a pair of Tonelli Hamilto- 
nians in the framework of weak KAM Theory to discover that the notions of Aubry 
set, of Peierls barrier and of weak KAM solution are invariants of the commutation 
property. Similar results were independently obtained in [20| I21j. 

This article deals with the first approach: we will consider purely continuous 
Hamiltonians, but we will keep the convexity and coercivity assumptions in the 
gradient variable. Here, we will say that H and G commute to simply mean that 
the multi-time Hamilton-Jacobi equation ([T|) admits a viscosity solution for any 
Lipschitz initial datum. This is formulated in terms of commutation of their Lax- 
Oleinik semigroups, and is equivalent to ([2|) when the Hamiltonians are smooth 
enough, see [8] and Appendix O 
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The purpose of the paper is to explore the weak KAM consequences of the com- 
mutation property in this setting. Our main achievement in this direction is the 
following Theorem, which generalizes the main new result of |46j: 

Theorem 1.1. Let H and G be a pair of continuous, strictly convex and superlinear 
Hamiltonians on x . // H and G commute, then they have the same weak 
KAM (or critical) solutions and the same Auhry set. 

We want to emphasize that the extension of this result to the non-regular setting 
was far from being straightforward. First, there is a problem of techniques: the 
crucial point in the proof of [46] is based on a careful study of the flows associated 
with H and G and exploits properties and tools developed in the framework of 
symplectic geometry and weak KAM Theory. For instance, a key ingredient is a 
deep result due to Bernard [10], stating that the Aubry set is a symplectic invariant. 
The use of all this machinery is only possible under strong regularity assumptions 
on the Hamiltonians. 

But there is more: looking at the arguments in |46j . one realizes that the commu- 
tation hypothesis ([2]) entails a certain rigidity of the dynamics and of the underlying 
geometric frame of the equations. Even if in the purely continuous case some analo- 
gies can be drawn, all this rich structure is lost. To put it differently, the problem 
did not seem to be just of technical nature: there was no a priori evidence that the 
result would continue to hold by dropping the regularity. 

The proof given here borrows some arguments from j46j, but the conclusion is 
reached via a different and rather simple remark on the time-dependent equations. 
Incidentally, with this idea the proof in the smooth case can be made considerably 
simpler. It is also worth noticing that Theorem 11.11 applies . in particular, to a pair of 
Hamiltonians of class satisfying ([2]), that is, to a case not covered by the previous 
works on the subject [201 [211 US]. As a byproduct, our study allows us to obtain a 
new result also for classical Tonelli Hamiltonians: 

Theorem 1.2. Let G and H he two commuting Tonelli Hamiltonians. Then they 
admit a C"*^'^ critical subsolution which is strict outside their common Aubry set. 

In the end, our research reveals that the invariants observed in the framework of 
weak KAM Theory are consequence of the commutation of the Lax-Oleinik semi- 
groups only, with no further reference to the Hamiltonian flows, that cannot be even 
defined in our setting. The only point where a kind of generalized dynamics plays a 
role is when we establish some differentiability properties of critical subsolutions on 
the Aubry set, which are crucial to state Theorem 11.11 in its full generality. These 
results are presented in Section [H where we will prove a more precise version of the 
following 

Theorem 1.3. Let H be a continuous, strictly convex and superlinear Hamiltonian 
on X M^. Then there exists a set T> C such that any subsolution u of the 
critical Hamilton-Jacobi equation is differentiable on D. Moreover, its gradient Du 
is independent of u on T>. Last, D is a uniqueness set for the critical equation, that 
is, if two weak KAM (or critical) solutions coincide on V, then they are in fact 
equal. 

These latter results are new and we believe interesting per se. They generalize, in 
a weaker form, Theorem 7.8 in [31], and bring the hope of extending to the purely 
continuous case the results of [31] about the existence of a critical subsolution, 
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strict outside the Aubry set. Such a generahzation, however, seems out of reach 
without any further idea. 

The article is organized as follows. In Section [2.11 we present the main notations 
and assumptions used throughout the paper, while in Section [2.21 we recall the defi- 
nitions and the results about Hamilton-Jacobi equations that will be needed in the 
sequel. Section [3] consists in a brief overview of weak KAM Theory for non-regular 
Hamiltonians. Some proofs are postponed to Appendix |Al In Section |4] we prove 
the differentiability properties of critical subsolutions above mentioned. In Section 
Owe examine the weak KAM theoretic aspects of the commutation property and we 
establish our main results for continuous and strictly convex Hamiltonians. Some 
auxiliary lemmas are stated and proved in Appendix [Bl Appendix [C] contains an 
argument showing the equivalence between the notion of commutation considered 
in this paper and the one given in terms of cancellation of the Poisson bracket when 
the Hamiltonians are of Tonelli type. 



2. Preliminaries 

2.1. Notations and standing assumptions. With the symbols and M_ we 
will refer to the set of nonnegative and nonpositive real numbers, respectively. We 
say that a property holds almost everywhere (o.e. for short) on M'^ if it holds up to 
a negligible subset, i.e. a subset of zero /c-dimensional Lebesgue measure. 

By modulus we mean a nondecreasing function from M-|- to vanishing and 
continuous at 0. A function g : M_|_ M will be termed superlinear if 

hm — ; — = +00. 

Given a metric space X, we will write <pn ^ ^ on X to mean that the sequence of 
functions {(pn)n uniformly converges to if on compact subsets of X. Furthermore, 
we will denote by Lip(X) the family of Lipschitz-continuous real functions defined 
on X. 

Throughout the paper, M will refer either to the Euclidean space or to the 
iV-dimensional flat torus T^, where N is an integer number. The scalar product in 
R'^ will be denoted by ( • , • ), while the symbol | • | stands for the Euclidean norm. 
Note that the latter induces a norm on T^, still denoted by | • |, defined as 

Ixl := min \x + k\ for every x G T^. 

We will denote by Br{xq) and Br the closed balls in M of radius R centered at xq 
and 0, respectively. 

With the term curve, without any further specification, we refer to an absolutely 
continuous function from some given interval [o, h] to M. The space of all such 
curves is denoted by W^'^{[a,h];M), while Lip^ ^([a, 6]; M) stands for the family of 
Lipschitz-continuous curves 7 joining x to y, i.e. such that 7(a) = x and 7(6) = y, 
for any fixed x, y in M. 

With the notation ||g||oo we will refer to the usual L°°-norm of g, where the latter 
will be either a measurable real function on M or a vector-valued measurable map 
defined on some interval. 

Let u be a continuous function on M. A suhtangent (respectively, supertangent) 
of u at xq is a function (p € C^{M) such that (/>(xo) = u{xq) and ^ u{x) for 
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every a; € M (resp., ^). Its gradient D(j)(xo) will be called a subdifferential (resp. 
superdifferential) of u at xq, respectively. The set of sub and superdifferentials of 
u at xq will be denoted D~u{xo) and D~^u{xo), respectively. We recall that u is 
differentiable at xq if and only if D^u{xq) and D~u{xq) are both nonempty. In this 
instance, D^u{xq) = D^u{xq) = {Du{xo)}, where Du[xq) denotes the differential 
of n at Xq. We refer the reader to [13j for the proofs. 

When u is locally Lipschitz in M, we will denote by d*u{xQ) the set of reachable 
gradients of u at xq, that is the set 

d*u{xQ) = {\\mDu{xri) : u is differentiable at x„, Xn — > xq }, 

n 

while the Clarke's generalized gradient dcu{xo) is the closed convex hull of d*u{xo). 
The set dcu{xo) contains both D~^u{xo) and D~u{xo), in particular Du{xo) € 
dcu{xQ) at any differentiability point xq of u. We recall that the set-valued map 
X 1-7' dcu{x) is upper semicontinuous with respect to set inclusion. When dcu{xo) 
reduces to a singleton, the function u is said to be strictly differentiable at that 
point. In this instance, u is differentiable at xq and its gradient is continuous at xq. 
We refer the reader to [17] for a detailed treatment of the subject. 

A function u will be said to be semiconcave on an open subset U of M if for every 
x & U there exists a vector px € such that 

u{y) — u{x) ^ {px,y — x) + \y — x\ uj{\y — x\) for every y G U, 

where a; is a modulus. The vectors px satisfying such inequality are precisely the 
elements of D^u{x), which is thus always nonempty in U. Moreover, dcu{x) = 
D~^u{x) for every x (z U, yielding in particular that Du is continuous on its domain 
of definition in U, see p^. This property will be exploited in the proof of Lemma 

ESI 

Throughout the paper, we will call convex Hamiltonian a function H satisfying 
the following set of assuptions: 

(HI) : M X ^ M is continuous; 

(H2) p I— > H{x,p) is convex on for any x € M; 

(H3) there exist two superlinear functions a, /3 : R_(_ — ?> M such that 
a {\p\) < H{x,p) ^ /3 {\p\) for all {x,p) G M x M^. 

We define the Fenchel transform L : M x — > M of via 

L{x,q) = H*{x,q) := sup {{p,q) - H{x,p)} . (3) 

The function L is called the Lagrangian associated with the Hamiltonian H; it sat- 
isfies the following properties, see Appendix A. 2 in |13j : 

(LI) L : M X ^ M is continuous; 

(L2) q 1-^ L{x, q) is convex on for any x G M; 
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(L3) there exist two superlinear functions a*,/3^, : — > R s.t. 

Q, ([^D ^ L{x,q) ^ /3, {\q\) for all {x,q) G M X M^. 

Remark 2.1. The functions a*, /3* and a, /3 in (L3) and (H3), respectively, can be 
taken continuous (in fact, convex), without any loss of generality. 

With the term strictly convex Hamiltonian we will refer to a convex Hamiltonian 
with (H2) replaced by the following stronger assumption: 

(H2)' p 1-^ H{x,p) is strictly convex on for any x € M. 

We point out that, in this event, L enjoys 

(L2)' q 1-^ L{x, q) is convex and of class C'^ on for any x € M. 

Furthermore, the map {x,q) i-^ DqL{x,q) is continuous in M x M^. This fact will 
be exploited in the proof of Proposition 14.41 Here and in the sequel, DqL{x, q) 
and DxL{x,q) denote the partial derivative of L at {x,q) with respect to q and x, 
respectively. An analogous notation will be used for the Hamiltonian. 

A Tonelli Hamiltonian is a particular kind of Hamiltonian satisfying conditions 
(HI), (H2)' and (H3). It is additionally assumed of class in MxR^ and condition 
(H2)' is strengthen by requiring, for every {x,p) G M x M^, that 

r. (x,p) is positive definite as a quadratic form. (4) 

The associated Lagrangian has the same regularity as H and enjoys the analogous 
condition ([4]). 

2.2. Hamilton— Jacobi equations. Let us consider a family of Hamilton-Jacobi 
equations of the kind 

H{x,Du) = a inM, (5) 

where a G M. In the sequel, with the term subsolution (resp. supers olution) of 
([5]) we will always refer to a continuous function u which is a subsolution (resp. a 
supersolution) of ([5]) in the viscosity sense, i.e. for every x G M 

H{x,p) ^ a for any p G D~^u{x) 

(resp. H{x,p) ^ a for any p G D~u{x) ). 

A function will be called a solution of ([5]) if it is both a subsolution and a superso- 
lution. 

Remark 2.2. Since H is coercive, i.e. satisfies the first inequality in (H3), it is 
well known that any continuous viscosity subsolution t> of (l5|) is Lipschitz, see for 
instance [4j. In particular, v is an almost everywhere subsolution, i.e. 

H[x,Dv{x)^ ^ a for a.e. x G M. 

By the convexity assumption (H2), the converse holds as well: any Lipschitz, almost 
everywhere subsolution solves (jS]) in the viscosity sense, see [43j . In particular, v is 
a subsolution of ([5]) if and only if —v is a subsolution of 

H{x,-Du) = a inM. 

6 



We define the critical value c as 

c = min{a € M : equation ([5]) admits subsolutions }. 
Following [31], we carry out the study of properties of subsolutions of ([5]), for a ^ c, 
by means of the semidistances Sa defined on M x M as follows: 

=inf 1^ aa{7{s),j{s))ds : 7 G Lip,,j^([0, 1]; M) | , (6) 

where aa{x,q) is the support function of the a-sublevel Za{x) of H, namely 

o-a{x,q) := sup {{q,p) : p £ Za{x)} (7) 

and Za{x) := {p € : H{x,p) ^ a}. The function cja{x,q) is convex in q 

and upper semicontinuous in x (and even continuous at points such that Za{x) has 
nonempty interior or reduces to a point), while Sa satisfies the following properties: 

Sa{x,y) ^ Sa{x,z) + Sa{z,y) 
Sa{x,y) ^ Ka\x-y\ 

for all x,y,z(zM and for some positive constant Kq. The following properties hold, 
see [31]: 

Proposition 2.3. Let a ^ c. 

(i) A function (j) is a viscosity suhsolution of ([^ if and only if 
(j){x) - (j){y) ^ Sa{y, x) for all x,y e M. 
In particular, all viscosity subsolutions of ^ are Ka-Lipschitz continuous, 
(a) For any y € M , the functions Sa{y, •) and —Sa{-,y) are both subsolutions of 

m- 

(Hi) For any y £ M 

Sa{y,x) = sup{?;(x) : V is a subsolution to ([5]) with v{y) =0}. 
In particular, by maximality, Sa{y, •) is a viscosity solution of ([5]) in M\{y}. 

Definition 2.4. For t > fixed, let us define the function : M x M by 

= inf |y°L(7,7)ds : 7 e 0]; M), 7(-t) = x, 7(0) = y| . (8) 

It is well known, by classical result of Calculus of Variations, that the infimum 
in ([8]) is achieved. The curves that realize the minimum are called Lagrangian 
minimizers. The following more precise result will be needed in the sequel, see 

Proposition 2.5. Let x, y £ M, t > and C € M such that h^{x,y) < tC. 
Then any Lagrangian niinimizer 7 for h^{x,y) is Lipschitz continuous and satisfies 
WiWoD ^ 1^, where k is a constant only depending on C, a*, 

We recall some properties of /i*, see for instance [22]. 

Proposition 2.6. Let t > 0. Then /i* is locally Lipschitz continuous in M x M. 
More precisely, for every r > there exists K = K{r,a^:, (3^^) such that the map 

{x,y,t) 1-^ h*{x,y) is K-Lipschitz continuous in C^, 

where Cr := {{x,y,t) G M x M x (0, +00) : \x - y\ < rt}. 
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We remark that, for every a ^ c, the fohowing holds: 

L{x,q)^ max {p,q) — H{x,p) ^aa{x,q) — a for every (x, q) G M x M''^, (9) 
peZaix) 

yielding in particular h*{y,x) + at ^ Sa{y,x) for every x, y € M. The next result 
can be proved by making use of suitable reparametrization techniques, see [23| [3T]. 

Lemma 2.7. Let a ^ c. Then 

Sa{y, x) = inf (ji^{y, x) + at^ for every x, 7/ G M, 
and the infimum is always reached when a > c. 

For every t > 0, we define a function on M as follows: 

(5(t)u)(x) =inf |u(7(0)) + j\{j,j)ds : e W^'\[-t,0]; M), 7(0) = x 

(10) 

where u : M — > M U {+00} is an initial datum satisfying 

u{-)^a\-\ + b on M (11) 

for some a, 6 G K. Any function of this kind will be called admissible initial datum 
in the sequel. 

The following properties hold: 

Proposition 2.8. 

(i) For every admissible initial datum u, the map {t,x) 1— )• (5(t)ii)(x) is finite 
valued and locally Lipschitz in (0, +00) x M. 

(a) (5(t))^^Q is a semigroup, i.e. for every admissible initial datum u 
S{t)(S{s)u) = S{t + s)u for every t, s > 0. 

(Hi) S{t) is monotone and commutes with constants, i.e. for every admissible 
initial data u, v and any a G M we have 

u^v =^ S{t)u^S{t)v and S{t){u + a) = S{t)u + a. 
In particular, S{t) is weakly contracting, i.e. 

\\S{t)u - S{t)v\\oo ^ \\u - v\\oo- 

(iv) If u £ Lip(M), then the map {t,x) 1— ?> (5(t)u)(x) is Lipschitz continuous in 
[0, +00) X M and 

lim \\S(t)u — u\\oo = 0. 

The semigroup (5(t))^^g is called Lax-Oleinik semigroup and (llOp is termed Lax- 
Oleinik formula. The relation with Hamilton-Jacobi equations is clarified by the 
next results. 

Theorem 2.9. Let H be a convex Hamiltonian and let L be its Fenchel transform. 
Then, for every uq G Lip(M), the Cauchy Problem 

{dtu + H{x,Du) = {) m(0,+oo)xM ^^^^ 
I n(0, x) = no(x) on M 

admits a unique viscosity solution u{t,x) in Lip([0,+oo) x M). Moreover, 
u{t,x) = [S{t)uo){x) for every (t,x) G (0, +00) x M. 



With regard to the stationary equation ([5]), the following characterization holds: 

Proposition 2.10. Let u he a continuous function on M . The following facts hold: 
(i) u is a subsolution of ([5]) if and only if t ^ S{t)u + at is non decreasing; 
(a) u is a solution of ^ if and only if u = S{t)u + at for every t > 0. 

Proof, (i) If u is a subsolution of then for every x, y £ M 

u{x) ^ u{y) + Sa{y, x) ^ u{y) + /i*(y, x) + at for every t > 0, 

hence 

u ^ inf {u{y) + h\y, ■) + at) = S{t)u + at. 

This readily implies, by monotonicity of the semi-group, 

S{h)u + ah ^ S{t + h)u + a{t + h) for every /i > 0, 

i.e. 1 1—)- S{t)u + at is non decreasing. 

Conversely, if t i-^ S{t)u + at is non decreasing, then for every fixed x, y £ M we 
have 

u{x) ^ u{y) + x) + at for every t > 0. 

By taking the infimum in t of the right-hand side term, we obtain u(x) — u{y) ^ 
Sa(y,x) for every x, y £ M hy Lemma [2771 i.e. u is a subsolution of ([5]). 

Assertion (ii) easily follows by noticing that u is a solution of ([5]) if and only if 
u{x) — at is a solution of ([12]) with uq := u. □ 

We conclude this section by proving a result that we will need later in the paper. 

Lemma 2.11. Let H be a strictly convex Hamiltonian and u an admissible datum. 
Then, for each x G M , the function t >->■ S(t)u{x) is locally semi-concave on (0, +cx3). 
Moreover, the modulus of semi-concavity is locally uniform in x. 

Proof. For simplicity, we prove the assertion for M = T^. The proof in the general 
case goes along the same lines, but one has to localize the arguments. 

Let / be an open interval compactly contained in (0, +oo). By compactness of 
it is not hard to see that there exists a constant C such that 

h^{x, y) ^ C t for every x,y £ and t £ I. 

Let K be the constant chosen according to Proposition 12.51 Fix x £ , t £ L and 
let 7 be a Lipschitz curve (of Lipschitz constant k) verifying 7(t) = x and such that 

{S{t)u){x) = n(7(0)) + f L{^{s),j{s)) ds. 

Jo 

For h such that \h\ < t/2 we set : [0,t + /i] ^ by 

^'^(^)=^(^)' s£[0,t + h]. 
By definition of the Lax-Oleinik semigroup, we have the following obvious inequality: 

(5(t + h)u) (x) ^ n(7(0)) + r\{^his),jh{s)) ds. 

Jo 
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Therefore, the following holds: 

{S{t + h)u)ix)-{Sit)u)ix)i^ r\{jh,ih)ds- I L(7,7)ds 



t , t + h 

T. 

We make a Taylor expansion to obtain that 



(l(7(s),7(s) • ^) • ^ - L(7(.),7(^))) d.. 



f r)T 

nlhl / K\h\ \ 2K\h\ /2k|/i| 



t + h \t + h^ 

where u; is a continuity modulus for dL/dq in x B2k- We deduce that 
{S{t + h)u){x) - {S{t)u){x) 

' (^L(7(.),7(^)) - -^{f^Hsl j{s)), 7(.)) + 2^a;(^))d. 
2k|/i|- 







= hpt + 2K\h\ uj 
where 



t 



Pt = y *(l(7(s),7(s)) - (|^(7(s),7(.)), 7(s)>) d. 



□ 



3. NONREGULAR WEAK KAM THEORY 

The purpose of this Section is to present the main results of weak KAM Theory 
we are going to use in the sequel. This material is not new. It is well known 
for Tonelli Hamiltonians, see [28], while the extension to the non regular setting is 
either contained in other papers or can be easily recovered from the results proved 
therein. Nevertheless, it is less standard and it is not always possible to give precise 
references. For the reader's convenience, we provide here a brief presentation. Some 
proofs are postponed to Appendix lAl 

Throughout this Section, M stands either for M.'^ or for T''^ and conditions (HI), 
(H2) and (H3) are assumed. 

We focus our attention on the critical equation 

H{x,Du) = c inM. (13) 

A subsolution, supersolution or solution of (113p will be termed critical in the sequel. 
To ease notations, we will moreover write S and a in place of Sc and Cc, respectively. 
Finally, by possibly considering H — c instead of H, we will assume c = 0. 
We define the Auhry set A as 

A:= {y M : S{y, •) is a critical solution}. 

In the sequel, we will sometimes write Sy to denote the function S{y, •). 
We will assume that the following holds 

(A) A is nonempty. 
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This condition is always fulfilled when M is compact, but it may be false in the non 
compact case. 

We define the set £ of equilibrium points as 

£ := {y ^ M : min H{y,p) =0}. 
p 

This set may be empty, but if not it is a closed subset of the Aubry set A. 

Next, we define a family of curves, called static. In the next Section we will 
investigate the behavior of the critical subsolutions on such curves. 

Definition 3.1. A curve 7 defined on an interval J is called static if 

5(7(^1), 7(^2)) = rL(7,7)ds = -5(7(t2),7(ii)) 

for every ti, t2 in J with t2 > ti. 

We first show that static curves are always contained in the Aubry set. 

Lemma 3.2. Let ^ he a static curve defined on some interval J. Then 7 is contained 
in the Aubry set and satisfies 

L(7(s),7(s)) = o-(7(s),7(s)) for a.e. s e J. (14) 

Proof. The definition of the semidistance S and inequality ([9]) with a = c readily 
implies that 7 enjoys f^^- 

Let us prove that 7 is contained in the Aubry set. If 7 is a steady curve, i.e. 
7(t) = y for every t £ J, then for (o, 6) C J we get 

ib-a)L{y,0)= [ L(7,7)ds = 5(y,y) = 0, 

J a 

yielding that y E <S C ^ for L{y, 0) = — miuj^iv H{y, ■). 

Let us then assume that 7 is nonsteady. We want to prove that, for every fixed 
t £ J, the point y := 7(t) belongs to A, i.e. that S{y, •) is a critical solution on 
M. Of course, we just need to check that S{y, •) is a supersolution of (fTSl) at y, by 
Proposition 12.31 To this purpose, choose a point z G 7( J) with z ^ y. Since 7 is 
static, we have 

S{y,z) + S{z,y) = 0. 

This and the triangular inequality imply that the function w{-) = S{y, z) + S{z, •) 
touches S{y,-) from above at y, hence D~Sy{y) C D^w{y). Since w is a viscosity 
solution in M \ {z} we derive 

H{y,p) ^ for every p € D~Sy{y), 

that is, Sy is a supersolution of (jl3p at y and so a critical solution on M. □ 

The next result states that static curves fully cover the Aubry set. 

Theorem 3.3. Let y £ A, then there exists a static curve rj defined on M with 
??(0) = y. 

This result is proved in [23j by exploiting some ideas contained in [3T]. A more 
concise and self-contained proof of this fact is proposed in the Appendix lAl 

We denote by /C the family of all static curves defined on M, and by /C(y) the 
subset of fC made up by those equaling y at t = 0. 
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The Peierls barrier is the function h : M x M ^M. defined by 

2/) = hminf y). (15) 

f— >-+oo 

The fohowing holds: 
Theorem 3.4. A = {y e M : h{y, y) = }. 

Proof. Take y (z M such that h{y,y) = and set n(-) := S{y,-). We want to 
prove that « is a critical solution in M; equivalently, by Proposition 12.31 that u is a 
critical supersolution at y. To this purpose, we first note that, since u is a critical 
subsolution on M, the functions S{t)u are increasing in t, see Proposition 12. 10] and 
equi-Lipschitz in x for u is Lipschitz continuous, see Proposition 12.81 Let us set 

v{x) = sup (S{t)u){x) = lim (S{t)u){x) for every x G M. 

According to what was remarked above, v ^ u. Furthermore, v is Lipschitz contin- 
uous provided it is finite everywhere, or, equivalently, at some point. We claim that 
v{y) = u{y). 

Lideed, let (tn)nGN be a diverging sequence such that lim„(=N /i*" (y, y) = h{y,y) = 
0. By definition of S{t) we have 

{S{tn)u) (y) < n(y) + /i*" (y, y) for each n G N, 

hence 

v{y) = lim {S{tn)u){y) ^ lim {u{y) + h^" (y , y)) = u{y) , 

n— >+oo ' ra— )-+oo ' 

as it was claimed. This also implies that v touches u from above at y, yielding 
D~u{y) C D~v{y). Furthermore, v is a critical solution since it is a fixed point of 
the (continuous) semigroup S{t), see Proposition I2.10| in particular it is a critical 
supersolution at y. Collecting the information, we conclude that 

H{y,p) ^ for every p G D~u{y), 

finally showing that u is a critical supersolution at y. 

Let us prove the opposite inclusion. Take y G A. To prove that h{y, y) = 0, it 
will be enough, in view of Lemma [2^1 to find a diverging sequence (tn)nGN such that 
liminf„6N h^"{y,y) = 0. 

To this purpose, let r/ G /C(y). Then 

-S{r]{n),y) = L{ri,f])ds = S{y,r]{n)) 
Jo 

for each n G N. By Lemma 12.71 there exist s„ > such that 

5(r/(n),y) < h^"[rj{n),y) < S{r]{n),y) + ^. 

By definition of /i* we get 

^"+'"(y,y) ^ /i"(y,r?(n)) +/i^"(r?(n),y) < S{y,r){n))+S{r]{n),y)+^ = i, 

and the assertion is proved by taking t„ := n + s„. □ 

Here and in the remainder of the paper, by H we will denote the Hamiltonian 
defined as 

H{x,p) := H{x, —p) for every (x,p) G M x R-^. 
The following holds: 
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Proposition 3.5. The Hamiltonians H and H have the same critical value and the 
same Auhry set. 

Proof. The fact that H and H have the same critical value immediately follows from 
the definition in view of Remark 12.21 Furthermore, the Peierls barrier h associated 
with H enjoys y) = h{y, x) for every x, y (z M. Hence H and H have the same 
Aubry set in view of Theorem 13. 4[ □ 

We end this section by proving some important properties of the Peierls barrier. 

Proposition 3.6. Under assumption (A) the following properties hold: 
(i) h is finite valued and Lipschitz continuous. 

(a) If V is a critical suhsolution, then h{y, x) ^ v{x) —v{y) for every x, y G M. 
(Hi) For every x,y, z M and t > 

h{y,x) ^ h{y, z) + h^{z,x) and h{y,x) ^ h^{y, z) + h{z,x). 
In particular, h{y,x) ^ h{y,z) + h{z,x). 
(iv) h(x, y) = S{x, y) if either x or y belong to A. 
(v) h(y,-) is a critical solution for every fixed y €z M . 

Furthermore, when M is compact and condition (H2)' is assumed, we have 

z4 h in M X M. 

Proof, (i) Let Ki be the constant given by Proposition 12.61 with r = 1. It is easily 
seen that for every bounded open set V C M x M there exists ty such that the 
functions {/i* : t ty} are i^i~Lipschitz continuous in V. Moreover we already 
know, by Theorem 13.41 that h{y, y) = for every y ^ A. This implies that h is finite 
valued and Lipschitz-continuous on the whole M x M. 

Items (ii) and (Hi) follow directly from the definition of h and from assertion (ii) 
in Proposition 12.61 

(iv) Let us assume, for definiteness, that y £ A. Let (tn)nGN be a diverging 
sequence such that ^ h^"{y,y) <l/n. Then for every t > and n G N 

S{x,y) ^ /i*+*"(3;,y) ^ /i*(x, y) + y) ^/i*(x,y) + -, 

n 

yielding 

S{x,y) ^ liminf h^{x,y) ^ inf h^{x,y) = S{x,y) 

t^+oo t>0 

in view of Lemma 12.71 

(v) By Proposition 12. lOL /^ii). it suffices to prove that S{t)hy = hy for every fixed 
t > and y € M, where hy denotes the function h{y, •). First notice that, by (Hi) 
and Lemma |2.7| 

hy{x) — hy{z) ^ inf = S{z,x), 
that is, hy is a critical subsolution. By Proposition 12.10T -(^i). that implies S{t)hy ^ 

hy. 

Let us prove the reverse inequality. For any fixed x € M, pick a diverging sequence 
(in)nGN with tn > t for every n G N and a family of curves 7^ : [— tn^O] M 
connecting y to x such that h^"{y,x) = J^^ L{jn,in) ds and 

lim / L{'jn,in)<is = h{y,x). (16) 

n— >+oo / . 
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The functions /i*" are equi-Lipschitz, see Proposition [2?6l This yields, by Proposition 
12.51 that the curves 7^ are equi-Lipschitz. Up to extraction of a subsequence, we 
can then assume that there is a curve 7 : [—t, 0] ^ M such that 

7„^7 in[-t,0] and 7n ^ 7 m L^(H,0];M^). 

Set z = 7(— t). By a classical semi-continuity result of the Calculus of Variations 
pT] . we have 

.0 

/i„(x) = limmf / L(7„,7n)ds 

n— >+oo / . 

^liminf / L(7„, 7„) ds + liminf / L(7„,7„)ds 

n— >+oo J _^ n— )-+oo J _^ 

rO 

^h{y,z)+ L{j,j)ds^ {S{t)hy){x). 



Last, let us show that uniformly converges to h for t ^ +00 when M is com- 
pact and condition (H2)' is assumed. Let y G M be fixed. Then the convergence of 
h^{y, ■) to h{y, •) is actually uniform, in view of the asymptotic convergence results 
proved in [71 [23] and of the equality •) = S{t — l)u with u = h}{y, •). The 
assertion follows from the fact that y was arbitrarily chosen in M and the functions 
{h^ : t ^ 1} are equi-Lipschitz in M x M in view of Proposition 12.61 □ 



4. Differentiability properties of critical subsolutions 

The purpose of this Section is to prove some differentiability properties of critical 
subsolutions on the Aubry set. These results will be exploited in the subsequent 
section to obtain some information for commuting Hamiltonians. 

Let us consider, for any fixed t > 0, the locally Lipschitz function defined on M 

as 

{S{t)u){-)= M^{uiz) + h\z,.)), 

where u is an admissible initial datum. If the latter is additionally assumed contin- 
uous, then the infimum is actually a minimum, and, as previously noticed, for every 
fixed y G M there exists a Lipschitz curve 7 : [—t, 0] — )• M with 7(0) = y such that 

{S{t)u){y)=u{-f{-t)) + J ^L(7,7)ds. 

As first step in our analysis, we prove some differentiability properties of S{t)u at y 
and of u at 7(— in terms of 7, thus generalizing to this setting some known results 
in the regular case, see ^28]. 

We start by dealing with the case when the Hamiltonian is independent of x. We 
need a lemma first. 

Lemma 4.1. Let H be a strictly convex Hamiltonian that does not depend on x. 
Then any (Lipschitz) Lagrangian minimizer 7 : [— 1,0] — t- M with t > satisfies 

D,L{j{s)) = DgL{Azjtll^ for a.e. s G [-t,0], (17) 

with equality holding for every s if ^ is of class C^. 
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Remark 4.2. We remark for later use that, since equality ()17p holds for almost every 
s G [—t, 0], then it holds in particular for every s that is both a differentiability point 
of 7 and a Lebesgue point of DqL{^{-)^ in [— 1,0]. 

Proof. Let us set 

7(0)-7(-0 , , . ^ 

V := ^ and r][s) = 7(Uj + sv. 

It is easy to see, by the convexity of L and Jensen's inequality, that 

fO />0 



j L{^)ds-^tL{v) = j L{i^)ds, 



-t J-t 
while the converse inequality is true since 7 is a Lagrangian minimizer. By exploiting 
the convexity of L again, we get 

L{q) ^ L{v) + {DqL{v),q - v) for every q G M^. (18) 

On the other hand. 



y° L(7(s)) ds = t L{v) = y° {l{v) + {DqL{v),^{s) 



v)] ds. 



meaning that we have an equality in ([18]) at 7(5) for a.e. s £ [— ^,0]. Equality ([T] 
follows by differentiability of L. □ 

Proposition 4.3. Let H be a strictly convex Hamiltonian that does not depend on 
X. Let u he an admissible initial datum and 7 : [— ^,0] M a Lipschitz continuous 
curve such that 7(0) = y and 

{S{t)u){y)=n{^{-t)) + y"°L(7(s))ds 

for some t > and y £ M . Then 

D,L{l^^l^^)£D^Sit)u)iy) and /..^(iM^liz!)) , 

Proof. To ease notations, we set 

^. ._ 7(0) - 7(-^) 
^ ■ t 

and denote by z the point 7(— t). Let us first prove that DgL{v) G D+ {S {t)u) (y) . 
According to the proof of Lemma |4.H it is enough to prove the assertion when 7 is 
the segment joining z to y. For every x G M, we define a curve '■ [—t, 0] — >■ M 
joining z to a; by setting 7a; (s) = 7(5) + {s + t){x — y)/t. Let 

.0 

ip{x) := u{z) + J L{%)ds, X G M. 

Then (^S{t)u){-) ^ (/?(•) with equality holding at y. It is easy to see, using the local 
Lipschitz character of L, that (p is locally Lipschitz continuous. We want to show that 
DqL{v) G D'^ip{y), which clearly implies the assertion as D~^ip{y) C L)+ (5(t)n) (y). 

By the standard result of differentiation under the integral sign, the function ip is 
in fact and we may compute its differential at y by the following formula: 

D^iy) = ( r §^L{ix) ds) I = D^L (v) . 
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Let us now prove that DqL{v) € D u[z). 

For every x G M, we define a curve r]^ ■ [—t, 0] —?■ M joining x to y by setting 
Vxis) := 7(s) + s {z — x)/t. Let 

il^{x) :=- J ^L{'^^)ds+ {S{t)u){y), x G M. 

Then ^(•) ^ n(-) with equality holding at z. We want to show that DqL{v) G 
D~ip{z)^ which is enough to conclude as D~ij){z) C D~u{z). Arguing as above, we 
actually see that t/^ is in fact and 

Dijiz)=DgL{v). 

This concludes the proof. □ 

We proceed to show a more general version of the previous result. 

Proposition 4.4. Let H be a strictly convex Hamiltonian andu an admissible initial 
datum. Let 7 : [—t, 0] — t- M 6e a Lipschitz continuous curve with 7(0) = y such that 

{S{t)u){y) = n(7(-t)) + L (7(5), 7(5)) ds 

for some t > and y € M . The following holds: 

(i) if is a differentiability point for and a Lebesgue point for DqL{^{-),^{-)^ , 
then DgL(7(0),7(0)) G D+ {S{t)u){y). 

(a) Assume u G Lip(M). If —t is a differentiability point for 7 and a Lebesgue 
point for DqL{-f{-),^{-)), then DqL[-f{-t),^{-t)) £ D-u{-f{-t)) . 

Proof. Let us choose an i? > 1 sufficiently large in such a way that ||7||oo ^ R and 
7([— i,0]) C Bfj. To ease notations, in the sequel we will call z the point j{—t). 

Let u : M+ M+ be a modulus such that 

\L{x,q) - L{y,q)\ ^ u){\x - y\f for every x,y £ B2R and q G B2R. 

If uj{h) = 0(h) then L{x,q) = L{q) on B2R x B2r, and the assertion follows from 
Proposition 14.31 when 7 is the segment joining z to y, and from Remark 14.21 when 7 
is any Lipschitz continuous minimizer. 

Let us then assume uj{h)/h is unbounded. Without loss of generality, we may 
require oj to be concave, in particular 

+00 as /i ^ 0+. 

h 

Let 5 : (0, +00) — > (0, +00) be such that 

d{h) uj{h) = h for every h > 0, 

i.e. 

•= — 77T fo'^ every h > 0. 
oj{h) 

Since S{t)u is Lipschitz in M, to prove assertion (i) it is in fact enough to show 
that the following inequality holds for every ^ G OBr: 

{S{t)u){y + hO - {S{t)u){y) ^ h{DqL{j{0),m),^) + o{h) for /i ^ 0+. (19) 
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To this purpose, for every h G [0, 1] and for every ^ G dBi we define a Lipschitz 
curve 7ftg : [—t, 0] — )■ M joining z to y + /i^ by setting 



By definition of [S{t)u), we get 



7(s) ifsG[-t,-.5(/i)] 
7(s)+^^(/i)(<5(/i)+s)e if s G [-5(/i),0]. 



{y + hO - {S{t)u) (y) ^ / (L(7h« , 7^?) - ^(t, t)) dt (20) 

-5{h) J-5{h) 
, ' ^ „ ' 

A B 

For h small enough we have 

\lhdt) - l{t)\ i^h<R for every t G [-6{h), 0], 

\ihdt)\ = + < 2R for a.e. t G [-S{h),0], 

hence 

mihii,ihi) - L{7,ih^)\ ^uj{hf for a.e. t€ [-6{h),0]. 

This yields 

Ai^6{h)oj{hf = huj{h). (21) 
To evaluate B, we use the Taylor expansion of L(7,7ftg) to get 

L(7,7 + u{h)() ^ L(7,7) + oj{h) {D,L{j, 7), + uj{h) e{uj{h)) 

for a.e. t G [—5(h), 0], where B is a continuity modulus for DgL on B2R x i?2_R- 
From this we obtain 

B ^ uj{h) / {D,L{-f,^),0 dt + 6{h)uj{h)e{uj{h)) 
J-S{h) 

^ /i(Z),L(7(0),7(0)),e> + /i/ \D,L{j,j)-DgL{j{0),'y{0))\dt + he{co{h)), 

J -5{h) 

i.e. 

B^h{D,L{-f{0),m),C) + o{h) (22) 

by recalling that t = is a Lebesgue point for Z)gL(7(-), 7(-)) . Relations ([2T]) and 
([22]) together with ([20]) finally give (fTUD . 

To prove (ii), it suffices to show, by the Lipschitz character of n, that for every 
fixed C G dBi 

u{y + hO-u{y)^h{DgL{j{0),'y{0)),^) + o{h) for /i ^ 0+. (23) 

To this purpose, for every h G [0, 1] and for every G dBi we define a Lipschitz 
curve r]h^ : [—t, 0] — ?• M joining z + h£, to y by setting 



7(s) + uj{h) {5{h) -t-s)i if s G [-t, -t + (5(/i)] 
7(s) if s G [-t + 5(/i), 0]. 
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By definition of we get 

t—t+S{h) 

u{z + hi) - u{z) ^ / {L{l,i) - L{Vh^,Vh^))<it 



-t+5{h) 

{L{-f, 7) - L(7, i^hO) dt + / (L(7, i)h^) - L{r]h^,-nhi)) dt . 

5(h) 



A' B' 

To evaluate B', we argue as above to get B' ^ —huj{h). To evaluate A', we use the 
Taylor expansion of L{'y,r]h^) to get 

L{j,j-u{h)C) ^ L{j,i)-u;{h) (D,L(7,7),e) +^(/i)e(a;(/i)) 

for a.e. t € [—6{h),0]. Arguing as above we finally get 

A' ^h{D,L{j{0),j{0)),C) + o{h), 

and (1231) follows. □ 



We now exploit the information gathered to deduce some differentiability proper- 
ties of critical subsolutions. In what follows, we stress the fact that we have assumed 
the critical value c to be equal to 0, which is not restrictive up to the addition of a 
constant to the Hamiltonian. 

We start by recalling some results proved in previous works. We underline that 
the compactness of M, which is assumed in these papers, does not actually play any 
role for the results we are about to state. The first one has been proved in \Sl\ . 

Proposition 4.5. Let H be a convex Hamiltonian. For every y (z M \ A the set 

ZQ{y) has nonempty interior and 

D-Sy{y) = Zo{y). 
In particular, Sy is not dijjerentiable at y. 

Therefore, critical subsolutions are in general not differentiable outside the Aubry 
set. The situation is quite different on it. A fine result proved in [31] shows that, 
when H is locally Lipschitz-continuous in x and condition (H2)' is assumed, all 
critical subsolutions are (strictly) differentiable at any point of the Aubry set, and 
have the same gradient. These results are based upon some semiconcavity estimates 
which, in turn, depend essentially on the Lipschitz character of the Hamiltonian in 
X. Something analogous still survives in the case of a purely continuous and convex 
Hamiltonian by looking at the behavior of the critical subsolutions on static curves, 
see [23] . 

Theorem 4.6. Let H be a convex Hamiltonian and 7 € /C. Then there exists 
a negligible set S C M such that, for any critical subsolution u, the map M07 is 
differentiable on M \ S and satisfies 

-^(uo7)(to) = (T(7(to),7(io)) whenever to eR\J:. (24) 



Here we want to strengthen Theorem 14. 61 by proving that, when condition (H2)' is 
assumed, any critical subsolution is actually differentiable at H^-a.e. point of 
We give a definition first. 
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Definition 4.7. Let 7 be an absolutely continuous curve defined on M. We will 
denote by T,^ the negligible subset of M such that M \ is the following set: 

{t£R:t is a differentiability point of ^ and a Lebesgue point of DqL{^{-),'^{-)) }. 

Theorem 4.8. Let H be a strictly convex Hamiltonian. Then, for any 7 G /C, every 
critical subsolution u is differentiable at 7(to) for any tQ \ S^, and we have 

Du{j{to)) = DgL{^{to),j{to)) for every to G K \ S^. (25) 

Proof. Fix to € M \ S. As u is a critical subsolution, it is easily seen that 

[S{to)u^{x) ^ u{x) for every x G M, 
with equality holding at 7(^0) since 

{S{to)u) (7(to)) ^ n(7(0)) + / ° L{j, 7) ds = u{j{to)) . 

Jo 

By this and by Proposition 14.41 we obtain 

D,L(7(to),7(to)) GD+(5(to)tx)(7(to)) C D+u{^ito)) 

Analogously 

rto+l 

(5(to + l)u) (7(to + 1)) = n(7(to)) + / ^(7, 7) ds, 

Jto 

and by Proposition 14.41 we have 

DgL{-f{to),^{to)) eD-u{-fito)). 

Then u is differentiable at 7(^0) and 1)^(7(^0)) = DqL(^j{tQ),j{to)) , as it was to be 
shown. □ 

Let us denote by 66 the set of critical subsolutions for H, i.e. the subsolutions 
of equation (fT3l) . We define the set 

V:= {y e M : V and Sy are differentiable at y, Dv{y) = DSy{y) } , (26) 
where Sy stands for the function S{y, •). The following holds: 

Proposition 4.9. Let H be a strictly convex Hamiltonian. Then T> is a dense subset 
of A. When M is compact, we have in particular that T> is a uniqueness set for the 
critical equation, i.e. if two critical solutions agree on T>, then they agree on the 
whole M . 

Proof. It is clear by Proposition 14.51 that T> is contained in A. Pick y A and 
choose a static curve 7 G /C passing through y. According to Theorem 14. 8( there 
exists a sequence of points y„ G 7(M) n T> converging to y. This proves that T> is 
dense in A. 

The fact that P is a uniqueness set is now a direct consequence of the fact that 
^ is a uniqueness set, see [31]. □ 

Remark 4.10. We underline for later use that, by definition of T>, any two critical 
subsolutions u and v are differentiable on T> and have same gradient. 
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5. Commuting Hamiltonians and critical equations 

The purpose of this section is to explore the relation between the critical equations 
associated with a pair of commuting Hamiltonians. We open by making precise what 
we mean by commuting when referred to a pair of convex Hamiltonians that are just 
continuous. After deriving a result that will be needed later, we restrict to the 
case when M is compact and we look into the corresponding critical equations. We 
discover in the end that the commutation property entails very strong informations. 

Throughout this section H and G will denote a pair of Hamiltonians satisfying 
assumptions (HI), (H2) and (H3). The following notations will be assumed 

• Lh and Lq are the Lagrangians associated through the Fenchel transform 
with H and G, respectively. 

• Sh and Sg denote the Lax-Oleinik semigroups associated with H and G, 
respectively. 

• h^fj and will denote, for every t > 0, the functions associated via ([8]) with 
H and G, respectively. 

• hn and he are the Peierls barriers associated with H and G, respectively. 

Definition 5.1. We will say that two convex Hamiltonians H and G commute if 

SG{s){SHit)u){x) = SHit){SG{s)u){x) for every s, t > and x e M, (27) 

and for every function admissible initial datum u : M — )• M U {+00} . 

Remark 5.2. Note that a Hamiltonian function H always commutes with itself. 
Also note that, when M is compact, any continuous function is an admissible initial 
datum. 

We emphasize that the notion of commutation given in Definition 15.11 is nothing 
but a rephrasing of the fact that the the multi-time Hamilton-Jacobi equation ([T]) 
admits a solution for every Lipschitz continuous initial datum. 

A very natural question is that of finding direct and easy-to-check conditions 
on the Hamiltonians that ensure the commutation property. As explained in the 
introduction, the problem has been already considered in literature. Here we recall 
one of the main results proved in [8J, that can be stated in our setting as follows: 

Theorem 5.3. Let H and G be a pair of convex Hamiltonians, locally Lipschitz in 
X, such that 

{G, H) := (D^G, DpH) - {D^H, DpG) = for a.e. {x,p) G Af x M^. 
// either H or G is of class G^ on M x M^, then holds for any u G Lip(M). 

Remark 5.4. The definition of commutation given above via (127p is actually equiv- 
alent to the cancellation of the Poisson bracket, {•,•}, when the Hamiltonians are 
additionally assumed of class C^. The proof of this fact is sketched in the introduc- 
tion of [8], and is detailed in Appendix [C] in the case of Tonelli Hamiltonians. This 
equivalence will be used to establish Theorem 15.151 see the proof of Lemma 15.161 

It would be interesting to understand if the null Poisson bracket condition can 
be somehow relaxed to less regular Hamiltonians. For instance, one may wonder 
if the commutation condition (I27p holds for pairs of locally Lipschitz Hamiltonians 
having Poisson bracket almost everywhere zero. We will describe in Remark 15.101 
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how a non-trivial class of locally Lipschitz Hamiltonians enjoying this property can 
be provided. 

We prove a result that will be needed in the sequel. 

Proposition 5.5. Assume Hi and H2 are two commuting convex Hamiltonians and 
set 

G{x,p) = max{Hi{x,p), H2{x,p)} for every {x,p) G M x M^. 
Then G commutes both with Hi and H2. 

We need three auxiliary results first. 

Proposition 5.6. A pair of continuous convex Hamiltonians H and G commute if 
and only if 

min(/i*^(y,z) + /i^(z,x)) = min z) + x)) (28) 

for every x,y ^ M and t, s > 0. 

Remark 5.7. Formula (j28p holds with minima even when M is non compact. In- 
deed, 



T 

and the same is valid for hQ{z,Q- This readily implies that the infima in (j28p are 
finite and that every minimizing sequence must stay in a compact subset of M. 

Proof. Let u : M ^ MU{+oo} be an admissible initial datum. Using the definitions 
and the commutation of two nested infima we get, for every x € M and t, s > 

SG{s){SH{t)u){x) = inf inf fe(C,z) + /i?;(z,x)+n(C) 

= inf ( inf {h^HiC z) + hUz, x)) + niO) , (29) 

Snit) {Sg{s) u) (x) = mf^ mf^ (/i^(C, z) + h'j,{z, x) + n(C) 

= mf^( mf^ (/i^(C,z) + /i*H(^,x)) +tx(C)). (30) 

Now, if H and G commute, then (I28p follows by plugging in the above equalities as 
u the function equal to at y and +00 elsewhere, for every fixed y G M. Conversely, 
if ([28]) holds true, then ([29|) and (i30]l are equal for any admissible n, so H and G 
commute. □ 

We set L{x,q) := min{L//^ (x, g), L//2(x,g)} for all {x,q) G M x M^. To ease 
notations, in the sequel we will write Li, h\ in place of Lui, h^u ■ recall that L* 
denotes the Fenchel transform of L, defined according to ([3]). 

Lemma 5.8. For every x, y (z M and t > 

hUx,y)=mfl [\{j,j)ds : -feG\[0,t];M),j{0)=x,j{t)=y\. (31) 



Proof. By classical results of Calculus of Variations, see for instance we know 
that the infimum appearing in (I3ip agrees with 

inf I r L**(7, 7) ds : 7 G ^^^'^[O, t];M), 7(0) = x, ^{t) = y 
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so to conclude we only need to prove that L** = Lq- From the inequalities G ^ Hi 
we derive Lq ^ Li for i G {1, 2}, so Lq ^ L. By duality 

G = L*a^L*^L* = H\ i e {1, 2}, 

so G L* ^ max{//i, H2} = G. Hence G = L* and consequently Lc = L**. □ 

Lemma 5.9. For every x, y (z M and t > 

n 

^cix^y) = inf I : xq = x, Xn = y^'^U = t, a ^ {1, 2}", n G n|. 

i=l i 

Proof. The fact that the right-hand side term of the above equality is non smaller 
than y) is an immediate consequence of the inequalities Li ^ Lg for i € {1, 2}. 

To prove the opposite inequality, in view of Lemma 15.81 it suffices to show that for 
every e > and for every curve 7 : [0, t] ^ M of class joining x to y we have 

e+ / L(7,7)ds^V / L^(i)(7,7)ds 

for a suitable choice of n G N, {tj : ^ i ^ n } and a G {1, 2}"'. 

To this purpose, choose a sufficiently large positive number R such that ||7||oo < R 
and 7([0,t]) C Br. Denote by w a continuity modulus for Li and L2 in Br x Br. 
Let r be an arbitrarily chosen positive number and choose n G N large enough in 
such a way that 

|7(s) — 7(t)| + [7(5) — 7(t)| < r for any s, r G [0, t] with \s — t\ < ^. 
Let := it/n for ^ i ^ n and define a G {1, 2}" in such a way that 
^<7{j)(7(*i)>7(^i)) = L{'~i{ti),^{ti)) for every 1 ^ i ^ n. 
For every s G tj] we get 

|^<7{i)(7(s),7(s)) - L(7(s),7(s))| ^ |L^(j)(7(s),7(s)) - (7(ti), 7(ti)) | 

+ |L(7(t,),7(ti)) -^(7(5),7(s))| ^2a;(r). 

Then 

ft ft 
y, / ' i^.w(7,7)ds^ / L(7,7)ds + 2t^^(r), 
j=l Jti-i Jo 

and the assertion follows by choosing r small enough. □ 

Proof of Proposition 15.51 Let us prove that G commutes with Hi, where i has 
been fixed, say i = 1 for definitiveness. In view of Proposition 15. 6( we need to show 
that (p8|) holds with Hi and G in place of H and G, respectively. Let us fix t, s > 
and X, y (z M. Let us show that 

mm {h^(.{x,z) + h'H^{z,y)) ^ min (x, z) + /i*^!^, y)) • (32) 

In view of Lemma [5.9|, it will be enough to prove that, for every n G N, the following 
inequality holds: 

n 

^h^;^^{xi-i,Xi) + hH^{xn,y) ^ mm {hH_^{x, z) + hQ{z,y)) (33) 

i=l 

for every a G {1, 2}", {xj : ^ i ^ n } with xq = x, {ti : ^ i ^ n } with Y^- ti = t. 
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The proof will be by induction on n. 
For n = 1 inequality ()33p holds true for 

ix,xi) + (xi , y) ^ mm [h^^^-^ (x, z) + {z, y)) , 

and we conclude since -ff(T(i) and Hi commute and ^ ^•^'^ every c7(l) G 

{1, 2}. 

Let us now assume that (|33p holds for n and let us show it holds for n + 1. Let 
a G {1,2}"+!, {xj : ^ i ^ n + 1} with xq = x, {U : i ^ n + 1} with = t. 

We have 

n 

+ h^^+\-^^{xn+i,y) + h'H^{xn,y) 

1=1 

n 

j=l 

n 

= ^ ^a(i) ' ^0 + (^Hi (^«' ^) + ^Sr(n+1) ' 

j=l 

where we used the fact that Hi and -f/^o-(n+i) commute. Let us denote by z a point 
realizing the minimum in the last row of the above expression. By making use of 
the inductive hypothesis we get 

n 
i=l 

^ min (h^nA^X) + h'a'"^\C,z)) + h';^^X^^{z,y) 
= min [h^^^ (x, C) + (C, ^) + /^iir+i) y)) 

^min(/i|,^(x,C) + /iG(C,y))- 

The opposite inequality in p2]) comes in an analogous way. The proof is complete. 

□ 

Remark 5.10. By suitably modifying the above arguments, we can prove the fol- 
lowing more general version of Proposition l5.5t let Hi and H2 be a pair of commuting 
continuous Hamiltonians and let / : — )■ M be a convex and increasing function. 
Here increasing means that 

/(ai, 02) < f{bi,b2) if ai < hi for i = 1, 2. 

Then Hi and H2 commute with f{Hi,H2)- The proof of this fact requires some extra 
work that is beyond the purpose of the current paper. Here we just want to explain 
how this procedure can be used to provide new non-trivial examples of commuting 
continuous Hamiltonians. Let Hi be locally Lipschitz and H2 of class such that 
their Poisson bracket is almost everywhere zero. Then we know from [8j that Hi and 
H2 commute. According to what is stated above, Hi and G := f{Hi, H2) commute. 
It does not seem to us that this example can be deduced from existing results in 
literature. 

We know restrict our attention to the case M = and we investigate on the 
relation between the associated critical equations. We will denote by ch and cq the 
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corresponding critical values of H and G, respectively. Up to adding a constant to 
the Hamiltonians, we will assume that ch = cq = 0. Note that this does not affect 
the commutation property. The symbols Sh-, Sq and Ah-, Ag refer to the critical 
semidistance and the Aubry set associated with H and G, respectively. 

We will also denote by G&h and &h the set of subsolutions and solutions of the 
critical equations H = 0, respectively, and by &&g and &g the analogous objects 
for the critical equation G = 0. 

We start with two results which exploit the fact that H and G commute. Actu- 
ally, the first result is a direct consequence of the monotonicity of the semigroups 
and does not require M to be compact. The second one uses the fact that the 
Lax-Oleinik semigroups are weakly contracting for the infinity norm and the proof 
is done applying DeMarr's theorem on existence of common fixed points for com- 
muting weakly contracting maps on Banach spaces [27]. The compactness of M is 
crucial to assure that such common fixed points are critical solutions for both the 
Hamiltonians. 

The proofs of these results may be found in [46j and will be omitted. 

Proposition 5.11. Let H and G be a pair of commuting convex Hamiltonians. 
Then, for every t > 0, we have 

SH(t)u € &6g for every u G &&g, 

SH{t)u € ©G for every u € &g- 



Proposition 5.12. Let H and G he a pair of commuting convex Hamiltonians. 
Then there exists uq € Gh H <3g- Ln particular, 

H{x,Duq{x)) = G{x,Duo{x)) = 

at any differentiability point x of uq. 

We now assume strict convexity of the Hamiltonians and we exploit the differ- 
entiability properties of critical subsolutions established in Section [J] to prove the 
following 

Theorem 5.13. Let H and G he a pair of strictly convex Hamiltonians. If H and 
G commute, then &h = &g- 

Proof. It is enough to show that <3g ^ ^h, since the opposite inclusion follows by 
interchanging the roles of H and G. 

Take u € &g- To prove that u G &h, it suffices to show, in view of Proposition 
\2J0\ -fii). that 

iS//(t)n = u on for every t > 0. 

Since SH{t)u S ©c, according to Proposition 14.91 it suffices to prove that 

SH{t)u = u on Vg for every t > 0. 

Let Uq G &&H n ©©G; and pick a point y G Vg- By definition of Vg, the function 
Uq is differentiable at y. Moreover, see Remark 14. 10( for every v G ©©c 

V is differentiable at y and L)v{y) = DuQ(y). 
Then the function w{t,x) := is differentiable at y for every t > and 

H[y, DMt, y)) = H{y, DuQ{y)) = for every t > (34) 
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by Proposition 15.121 

Now we use the fact that is a solution of the evolutive equation 

dtw + H{x,D^w) = in (0, +00) X T^. 

The underlining idea is very simple. To focus this point, we will first establish the 
result by adding a mild regularity assumption on w. Then we will deal with the 
general case, where some technicalities arise. 

First Case: w is locally semiconcave in (0,+cx3) x T^. 

This condition is always fulfilled if, for instance, H is locally Lipschitz continuous 
in X, see [Hj. Since the map t 1— )• w{t,y) is Lipschitz continuous, it is differentiable 
for a.e. t > 0. In view of Lemma iB.ll and of ()34p . we infer 

dtw{t, y) = dtw{t, y) + H[y, D^w{t, y)) = for a.e. t > 0, 

yielding that w{-,y) is constant in Hence 

{SH{t)u) (y) = u{y) for every t > 0, 

as it was to be shown. 
The general case. 

We only need to prove that w{-,y) is constant, i.e. that 

dtw{t,y) = for a.e. t > 0. 

First we recall that, by convexity of the Hamiltonian, the fact that w is a subsolution 
of the evolutive equation is equivalent to requiring 

pt + H{x,px) < for every {pt,Px) S dcw{t, x) 

for every {t,x) G (0, +00) x T^. Now the functions {w{-,x) : x G T^} are locally 
equi-semiconcave in (0, +cxd), see Lemma 12.111 Moreover w has partial derivatives 
at {t,y) for a.e. t > 0, so in view of Lemma [6.21 we get 

dtw{t, y) = dtw{t, y) + H{y, D^w{t, y)) < for a.e. t > 0. (35) 

Let us prove the opposite inequality, i.e. 

dtw{t,y) > at any differentiability point t > of the function w{-,y). 

In fact, if this were not the case, there would exist Iq > such that w{-,y) is 
differentiable at to and 

dtw{to,y) < —e for some e > 0. 

Since w is locally semiconcave in t, uniformly with respect to x, we infer that there 
exist r > such that 

dtw{t,x) < —e for a.e. (t,x) G Br{to) x Br{y). (36) 

This follows from [13\ Theorem 3.3.3], which implies here the continuity of dtw with 
respect to (t, x) on its domain of definition (via an argument analogous to the one 
used in the proof of Lemma IB.ip . 
By Lemma IB. 31 we infer that 

H(x,D{SH{to)u)) >e mBr{y) 

in the viscosity sense. On the other hand, SH{to)u G Sc, it is hence differentiable 
at y and 

H{y,D{SH{to)u){y)) =0, 
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yielding a contradiction. □ 



Theorem 1 5 . 1 3 1 has very strong consequences from the weak KAM theoretic view- 
point. Indeed, we have 

Theorem 5.14. Let H and G be a pair of commuting, strictly convex Hamiltonians. 
Then 

(i) hn = he on x T^; 
(a) Ah = Ag; 

(Hi) Snix^y) = SGix,y) if either x or y belong to Ah = Ac- 

Proof, (i) Let us arbitrarily fix y € T^. By Proposition 13.61 ^uiV: •) and hciy, ■) 
both belong to Gh = so 

Sg{s) hniy, •) = huiy, ■), Snit) hdy, •) = h^y, •) 

for every s,t > 0. Moreover 

h^H ^ fiH and /i^ ^ ha in x T^. 

Let us denote by u the function equal to at y and +oo elsewhere. For every s > 
we have 

hniy, ■) = Sg{s) hniy, •) = lim Sg{s) h^iy, •) 

t— >+oo 



lim SGis)SH{t)u = lim 5g(s)u = lim SH{t)hQ{y, 



We derive 



\\hH{y, •) - hciy, ■)\\oo = ^ Hrn^ \\SHit){hUy, •)) - SH{t){hGiy, •)) L 

^ Whhiy,-) -hG{y,-)\\oc, 

and the assertion follows sending s — )• +00. 

Assertions (ii) and (Hi) are a direct consequence of (i) in view of Theorem 13.41 
and of Proposition 13.61 respectively. □ 

Next, we show that H and G admit a common strict subsolution. 

Theorem 5.15. Let H and G be a pair of commuting, strictly convex Hamiltonians, 
and let A denote Ah = Ac- Then there exists v € &Gh H G&g which is C°° and 
strict in \ A both for H and for G, i.e. 

H{x,Dv{x))<0 and G{x,Dv{x))<0 for every x e \ A. (37) 

If H and G are locally Lipschitz continuous in x M.^ , then v can be additionally 
chosen in C-'^(T^). 

Finally, if H and G are Tonelli, then v can be chosen in G^'^^T'^). 

Proof. Let us set 

F{x,p) := max{H{x,p), G{x,p)} for every (x,p) S x M^. 

This new Hamiltonian still satisfies (HI), (H2)' and (H3). Moreover any u S <3h = 
6g solves the equation 

F{x,Du) = inT^ 

in the viscosity sense, as it is easily seen by definition of F. This yields cp = and, 
according to Proposition 15.51 and Theorem 15.141 Ap = A. 
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We now invoke the results proved [3T]: by Theorem 6.2, there exists a critical 
subsolution v for F which is strict and smooth in T''^ \ ^. If and G are locally 
Lipschitz, the same holds for F, so v can be additionally chosen of class on the 
whole in view of Theorem 8.1. The inequalities (|37p follow since F ^ H, G. 

If now H and G are Tonelli Hamiltonians, the commutation property is equiv- 
alent to the fact that the Poisson bracket {H, G} = everywhere, as explained in 
Appendix [O Starting with a (or in fact any) common strict subsolution v, it is 
possible to realize, as in [9], a Lasry-Lions regularization vq of v, using alternatively 
the positive and negative semigroups of H. More precisely, 

vo = SH{t) {S^{s)v) 

for s and t suitably chosen, where the positive Lax-Oleinik semigroup is defined as 
follows: 

S+is)v = -{Sfji-v)). 

Note that vq is still a subsolution both for G and for H, see Remark 12. 21 and Propo- 
sition 15.111 The fact that it is strict in \ ^ is proved in the next lemma. The 
fact that Vq is C^'^ for t and s small enough is proved in [9j. □ 

We recall that a Lipschitz subsolution v G &&g is said to be strict in an open 
set U C if for any xq G U there is a neighborhood V of xq and a constant s > 
such that G[x, Dv{x)^ < —e almost everywhere in V . 

Note that if v\?,C^^ it is strict on U if and only if G(x, Dv{x)) < for any x G C/. 

Lemma 5.16. Let G and H be two commuting Tonelli Hamiltonians. Assume v 
is a critical subsolution for G which is strict outside A. Then, for all t > 0, both 
Scit) V and Snit) v are critical subsolutions for G, strict outside A. 

Proof. We will only prove the result for SH{t)v. The result for SG{t)v is then a 
consequence for G = H. We already know by Proposition 15.111 that is a 

critical subsolution of G. It is only left to prove the strict part. This is done in two 
steps: in a first one, we prove a point wise strictness at differentiability points of 
Snit) V. In a second one, we extend this result using Clarke's gradient to any point 
before concluding. 

Let xeT^\A. Consider a curve 7 verifying that 7(0) = x and 

{SH{t)v)ix)=v{ji-t)) + J ^L^^(7(s),7(s))ds. 

The curve (7,7) is then a piece of trajectory of the Euler-Lagrange flow of H. It 
is also known (see ^28j or Proposition 14. 4p that DqLH{'y{—t),'j{—t)) € D^v(^--f{—t)) 
and 

DqLH{^{s),j{s)) eD+{SH{t + s)v){^{s)) for every s€ (-t,0]. 

Moreover, the curve 7 does not intersect A. Indeed, if this were not the case, the 
curve (7,7) would be included in the lifted Aubry set, which is invariant by the 
Euler-Lagrange flow of H, see [28], while x = 7(0) ^ A. We therefore deduce that 
7(— t) ^ A and, since v is strict, 

G(^y{-t),DgLH{7i-t),ji-t))) <0. 

Now G and H commute; since they are Tonelli, this means their Poisson bracket is 
null, see Proposition IC.ll Otherwise stated, G is constant on the integral curves of 
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the Hamiltonian flow of H, in particular on s i— )• ^7(5), DgL/^ (7(5), 7(5)) j . Thus 

g(x,Z?,Lh(x,7(0))) <0, 

from which we infer that G {x,D{SH{t) f ) (x)) < whenever Snit) v is differentiable 
at X. But this is not sufficient to conclude since the function SH{t)v is Lipschitz 
continuous in T^, hence differentiable almost everywhere only. We will prove the 
following: 

Claim. Let x ^ A. Then 

G{x,p) < for every p G d*[SH{t)v){x), 

where 9* (x) denotes the set of reachable gradients of SH{t)v at x. Note 

that since Snit) v is Lipschitz, this set is compact. 

Let p G d*[SH{t) v) (x) and consider x„ — >■ x a sequence of differentiability points 
for Snit) V such that (x„) p. For each n, choose a curve 7„ : [—t, 0] ^ 

(which is in fact unique) such that 

(5//(t)t>)(x„) = i;(7„(-t)) + J L/^(7„(s),7„(s)) ds. 

For each n, the curve (7ra,7n) is the (only) trajectory of the Euler-Lagrange flow 
with initial condition verifying DqL}{ (xjn'jn 

(0)) = D{SHit)v){xn). By continuity 
of this flow, they uniformly converge, along with their derivatives, to a curve 7. By 
continuity, we obtain 

{SHit)v)ix)=v{ji-t)) + J ^LH{-f{s),j{s))ds. 

Moreover, by passing to the limit in the equalities DgLn (x^, 7ra(0)) = D(5//(t) v) (x„), 
we obtain 

DgLH{x,m) =P- 

By arguing as above and by exploiting the fact that x ^ A, we obtain G{x,p) < 0. 
Since G is convex, we infer 

G{x,p) < for every p € 9c(5/f(t) v) (x), 

where 5c (5// (t) ?j)(x) denotes the Clarke differential of Snit) v at x, defined as the 
convex hull of d* {SH{t)v){x). We now exploit the fact that the Clarke differential 
is upper semi-continuous with respect to the inclusion and point wise compact, see 
[T7]. Let xq ^ A and choose e > in such a way that 

G(xo,p) < -2e for every p G dc{SH{t)v){xQ). 

Then there exists a neighborhood V of xq such that 

G{x,p) < —e for every p G d{Sii(t) v) (x) and x G F. 

In particular, G[x, Dv{x)^ < —e for almost every x G V. The proof is complete. □ 
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Appendix A. 

The purpose of this Section is to give a self-contained proof of Theorem 13.31 We 
prove two lemmas first. Recall that we are assuming that the critical value c is equal 
to 0. 

Lemma A.l. Let 7 : [a, 6] — )• M such that 

5(7(6), 7(a)) + [' L{j,j)ds = 0. (38) 
J a 

Then ^ is a static curve. 

Proof. Let s, t be points of [a, b] with s < t. We want to prove that 

-S(7(t),7(s)) =_^*^(7,7)dr = S(7(s),7(i))- (39) 
We set y := 7(6) and observe that equality p8]) can be equivalently written as 

rb 

S{y,7ib)) - S{y,'y{a)) = L(7,7)ds. 

J a 

Since S{y, •) is a critical subsolution, the following hold: 

S{y, j{b)) - S{y, 7(t)) ^ L{j, 7) ds. 

and ^ 

S{yn{t))-S{yn{a)) ^ [ L{j,j)ds. 

J a 

Both inequalities are in fact equalities (summing them up gives an equality) and we 
obtain ^ 

-S{y,^{t)) = S{y,j{b)) - S{y,j{t)) = L{j,j)ds 
for any t £ [a,b]. We infer 

rb 

= 5(y,7(t))+ L(7,7)dr^S(2/,7(t))+S(7(t),y) ^0, 

so 

rb 

S{l{t),y)= L(7,7)dr = -5(y,7(t)). 
Li particular for every a ^ s < t ^ b 



S{^{s),y)-S{j{t),y)= J L(7,7)dr. 
The second equality in ([39]) then follows since 

S{^{s),y) - S{j{t),y) ^ S{j{s),j{t)) ^ f L{^,^)dT. 



Let us now prove the other equality in (j39|) . By making use of what was just proved, 
we have 

ft 

L(7,7)dT = S{-i{s),y) - S{-i{t),y) 



S(y,7(5)) +5(7(t),y)) ^ -S(7(t),7(s)), 
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and the assertion follows for 

*L(7,7)dT + 5(7(t),7(s)) ^S(7(s),7(t))+5(7(t),7(s)) ^0. 



□ 



Lemma A. 2. There exists a real number R > such that 

\J{q€R^ : L(x, q) = a{x, q) } C Br. 

Proof. By assumption (H3) there exists a constant k such that Zq{x) C B,^ for 
every x G M, so <j{x,q) ^ K\q\ for every {x,q) € M x M^. By (L3) and by the 
superlinear and continuous character of a*, see Remark |2.H there exists a constant 
Oo > such that 

{k + l)\q\ - ao ^ ^ L{x, q) for every {x, q) e M x . 

The assertion follows by choosing R := oq. □ 

Proof of Theorem 13.31 Fix y & A and set u{-) = S{y,-). The function w{x,t) = 
u{x) is a solution of the equation 

dtw{x, t) + H{x, D^w{x, t)) = 0, (40) 

hence S{t)u = u for every t > 0. In particular, for each n € N there exists a curve 
7„ : [— n, 0] — )■ M with 7n(0) = y such that 

u{y) = u{-in{-n)) + / L(7„,7n)ds. 

^ —n 

Now ^(y) = and ti(7„(— n)) = S(yy,'^n{—'n)), so by Lemma [A. II we derive that 
7n is a static curve. Lemma IA.2I guarantees that the curves 7„ are equi-Lipschitz 
continuous, in particular there exists a Lipschtiz curve 7 : M_ — > M such that, up 
to subsequences, 

7„^7 inM_ and 7n ^ 7 m L[„,(M_;M^). 

By a classical semi-continuity result of the Calculus of Variations [llj we have 



liminf / L(7„,7„)ds^ / L(7,7)ds 
"-^+°° J a J a 



for every a < 6 ^ 0, yielding in particular that 7 is static too. 

We now consider the Hamiltonian H(x,p) = H{x,—p). By Proposition 13.51 we 
know that the critical value and the Aubry set of H agree with (i.e. the critical 
value of H) and A. We can apply the previous argument with S and L in place of 
S and L to obtain a curve ^ : M_ — )• M which is static for H. We define a curve 
T/ : E ^ M by setting 



r/(s) := 



^(-s) ifs^O 
7(s) if s ^ 0. 



We claim that r/ is the static curve we were looking for. To prove this, it will be 
enough, in view of Lemma lA.ll to show 

S{r^ib),r]ia)) + [\{r^,^)ds = (41) 

J a 
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for any fixed a < < 6. Indeed, by noticing that L{x,q) = L{x, —q) and S{x,y) = 
S{y, x), we obtain 

/' L{rj, v) ds = f L{C, i) ds = -S{m,a-b)) = -S{ri{b),ri{0)) . 

Jo J~b 

Hence 

pb pQ rb 

/ L{r],f])ds = / L{r],f])ds+ / L{ri,T])ds 
J a J a Jo 

= -S{v{b),m)+S{ri{0),r,{a)) ^ -S{ri{b),r,{a)) 
and dH]) follows since the opposite inequality is always true. □ 



Appendix B. 

In this appendix we prove three auxiliary lemmas that are needed in the proof of 
Proposition 15.121 

Lemma B.l. Let w{t,x) be a locally semiconcave function in (0, +oo) x T^. Then 
w has partial derivatives at a point {tQ,xo) if and only if it is (strictly) differentiable 
at that point. 

Proof. Let us assume that w has partial derivative at a point {to^xo). It will 
be enough to show that the set d*w{to,xo) of reachable gradients of w at (to,xo) 
reduces to the singleton (^dtw{to, xq) , Dxw{to, xq)) . Indeed, let {pt,Px) € d*w{tQ,xo) 
and take a sequence {tn,Xn) of differentiability points of w converging to [tQ^xo) 
such that 

dtw{tn,Xn) =■■ Pt„ Pt, D^w{tn, X„) =: Px„ Px 

as n — > +00. The functions 

(pnit) := W{t - to + tn,Xn), Ipnix) = w{tn,X- Xq + Xn) 

are locally equi-semiconcave in (0, +oo) and and differentiable at the points 
t = to and X = xq, respectively. Moreover 

(j)n^w{-,xo) in(0, +oo), i{jn^w{to,-) in T^. 

By a well known fact about semiconcave functions, see Theorem 3.3.3 in [T3], we get 

Ptu = </'n(*o) dtw{to,xo), px„ = Dx^{xo) DxW{to,Xo), 

that is {pto,Pxo) = {dtw{to,xo),Dxw{to,XQ)). □ 

In the subsequent lemma, by vri we will denote the projection of M x onto the 
first variable, i.e. T^i{pt,Px) = Pt for every {pt,Px) € M x R^. 

Lemma B.2. Let w{t,x) be a locally Lip schitz function on (0,+oo) x T^. Let us 
assume that the family of functions {uj{-,x) : x € T^} are locally equi-semiconcave 
in (0, +oo). If w has partial derivatives at a point {to,xo), then 

(i) TTi{dcw{to,xo)) = {dtw{to,xo)}; 
(a) {dtUj{to,xo),Dxw{to,xo)) £dcw{to,xo). 
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Proof. Assertion (i) follows arguing as in the proof of Lemma IB. II above and 
exploiting the semiconcavity of w in t. To prove item (ii) we argue as follows. 
Assume by contradiction that DxW^to, xq) does not belong to iT2[dc'w(to, xo)^ Here 
7r2 denotes the projection of M x in the second variable, i.e. T^iipt^Px) = Px 
for every {pt,Px) € M x M^. The set TT2{dcw{to, xq)^ is closed and convex, so by 
Hahn-Banach Theorem there exist a vector q and a constant a G M such that 

{Dxw{to,xo), q) <a< {p,q) for every p G dcw{to,xo). 

By upper semicontinuity of Clarke's generalized gradient, the above inequality keeps 
holding in a neighborhood V of {tQ,xo), i.e. for every {t,x) £ V 

{Dxw{to,Xo), q) < a < {p, q) for every p € dcw{t, x). 

For h ^ 0, let us consider the ratio 

w{to,xo + hq) - 'w{to,xo) 
r{h) = . 

By the Nonsmooth Mean Value Theorem, see Theorem 2.3.7 in [T7], there exists a 
point Xh on the segment joining xo to xq + hq and a vector {ah,Px,^) G dcw{to, Xh) 
such that 

r{h) = {{ah,PxJ, (0,g)) = {p^^, q). 
For h small enough, we infer that r{h) > a. On the other hand 

limr(/i) = {Da;w{tQ,XQ), q) < a, 

ft,->0 

yielding a contradiction. □ 
We conclude this appendix by proving the following 

Lemma B.3. Let H : xM^ ^ M 6e a continuous function and w{t, x) a Lipschitz 
function on x satisfying 

dtw + H{x,Dw) ^ m(0,+oo)xT^ 
in the viscosity sense. Let us assume that 

(i) the functions {w{-,x) : x € } are locally equi-semiconcave in (0, +oo); 
(ii) there exist a constant a € M and two open sets I C (0, +oo) and U C 
such that 

dtw{t,x) < a for a.e. t £ L and for a.e. x € U. 
Then, for every to G /, the function u*" := w{tQ, •) satisfies 

H{x,Du^o)^-a inU (42) 

in the viscosity sense. 

Proof. We divide the proof in two steps. 

Step 1. Let us additionally assume that, for every t > 0, the function 

w{t,-) is locally semiconcave in T^. 

Let S := {{t,x) G (0, oo) x : vu is not differentiable at {t,x) }. Then, for a.e. 
t > 0, the set 

S* := {x G : G S} 

has A^-dimensional Lebesgue measure equal to 0, so, for any such t > 0, 
dtw{t, x) + H{x, Dw{t, x)) ^ for a.e. x G T^. 
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In particular, 

H (^x, Dw{t,x)) ^ —dtw{t,x) > —a for a.e. x G [/. (43) 

Set v!" = w{t, ■). By semiconcavity, the inequality (j43]l means that 

H{x,Du^)^-a in f7 (44) 

in the viscosity sense. Here we have used the fact that Du^ is continuous on its 
domain of definition and that the supersolution test is nonempty only at points 
where u* is differentiable. If now to is any point of I, we choose a sequence of points 
in G / converging to to for which ()44p holds for every n. Since u*" ^ n*° in T^, by 
stability of the notion of viscosity supersolution we get ()42p . 

Step 2. Let (to,xo) G / x [/. Since the functions w{-,x) are locally equi- 
semiconcave in t, we infer that there exists r > such that 

dtw{t,x) < a for a.e. {t,x) £ -B2r(io) ^ B2r{xo). (45) 

For every n G N, set 

Wn(t, x) = min {w(t, y) + n\x — yP}. 

Each Wn{t, •) is semiconcave in for every fixed t > and satisfies the following 
inequality in the viscosity sense 

dtWn + H{y, D^Wn) ^ -Sn in (0, +oo) x T^, 

where {6n)neN is an infinitesimal sequence, see [13]. Let us denote by Y{t,x) the set 
of points y G T-^ which realize the minimum in the definition of Wn{t, x). If L is the 
Lipschitz constant of w in x T^, it is well known that 

dist(y(t, x), x) ^ — for every n G N. 

Furthermore 

dtWnit' ,x') = dtw{t' ,y) for every y G Y{t',x') (46) 

at any point {t',x') where Wn has partial derivative with respect to t. Indeed, if 
ip{t) is a subtangent to Wn{-,x') at the point t', the function ip{t) — n\x' — is a 
subtangent to w{-,y) at the point t', so (j46p follows by semiconcavity of Wn and w 
with respect to t. 

In particular, for n big enough, 

dtWriit^x) < a for a.e. (t,x) G Br{to) x Br{xo). 

By Step 1 we infer that the functions u^^ = Wn{to,-) satisfy 

H{x,Du^°) ^ -a - 6n in Br{xo) 

in the viscosity sense. Since ^ u^" = t(;(to,-) in T^, we conclude by stability 
that 

H{x,Du^'^>) ^ -a inB,,(xo). 

The assertion follows since to and xo were arbitrarily chosen in / and U, respectively, 
together with the fact that the notion of viscosity supersolution is local. □ 
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Appendix C. 



In this Appendix, we discuss the equivalence between the notion of commutation 
given in Definition 15.11 and the one given in terms of cancellation of the Poisson 
bracket when the Hamiltonians are regular enough. In [8j it is proved that for two 
convex C^-Hamiltonians, G and H, having null Poisson bracket, i.e. 

{G, H} := {D^G, DpH) - {D^H, DpG) =0 in M x M^, 

the multi-time Hamilton-Jacobi equation ([1]) admits a (unique) viscosity solution 
for any Lipschitz initial datum uq. This amounts to saying that the Lax-Oleinik 
semigroups commute in the sense of (|27p . In [8j, the question of the reciprocal 
statement is treated by a heuristic argument. We feel natural to give a neat proof of 
this fact, at least in the case of Tonelli Hamiltonians. For clarity of the exposition, 
we will place ourself in the case of M = T^, but the results remain true if Af = M . 

Proposition C.l. Let G and H be two Tonelli Hamiltonians on x M^. Assume 
that 

Sg{s) {Snit) u) (x) = Snit) (5g(s) u) (x) for every s, t > and x e T^, (47) 

and for every admissible initial datum u : ^ M U {+00} . Then the following 
relation is identically verified: 

{D^G, DpH) - {D^H, DpG) = in x M^. 

In order to prove this, we will use some results about the behavior of solutions 
of the Hamilton-Jacobi equation with smooth initial datum. We introduce some 
notations. If / : ^ R is differentiable, then r(/) c x will denote the 
graph of its differential. We will denote by (pc (resp. (pn) the Hamiltonian fiow of 
G (resp. H), that is, the flow generated by the vectorfield 

Xg{x,p) = {x,p, DpGix,p), -D,Gix,p)), {x,p) G x R^, 

resp. Xh{x,p) = {x,p, DpH{x,p), -DxH{x,p)) 

The following is a reformulation of Lemma 3 in [9j : 

Proposition C.2. For any G^ function u : R, there is an e > such that 

for any s,t < e, the functions Ug^t = 5^(5) (5^/ (t) ti) and u*'* = SH{t)(SG{s) u) are 
C^. Moreover, T{us,t) = (t)G° (t>*H^{u) andT{u''^^) = (jf^j o (t)l.T{u). 

Finally, for t < e fixed (resp. s < e fixed), the function (s,x) ^ Us^t{x) {resp. 
{t,x) I— 7- n'*'*(x)) is a classical solution to the Hamilton Jacobi equation 

-^ + G{x,D^Us,t)=0 m(0,+oo)xT^, 

OS 

(resp. + H{x, D^u'^^) = in (0, +00) x ). 

Proof of Proposition IC.ll Let us use Proposition IC.21 diff^erentiating various 
times the Hamilton-Jacobi equation, to compute a Taylor expansion of Us^t for small 
times and smooth initial datum: 

^2 Q 

Us,t{x) = uo,t{x)-sG{x, DxUo,t{x))-— {DpG{x, D^uo^t{x)) , -^D^UQ^t{x) )+o(s^) 



uo^t{x)-sG{x, D^UQ^t{x)) +— {DpG{x, DxUo,t{x)) , D,j,G{x, D^uo,t{x)))+o{s 



2 



2^ 
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Notice that similarly, 

uo,t{x) = u{x) -tH{x,Du{x)) + — {DpH{x,Du{x)), D-^H{x, Du{x))) + o{t^) 
and 

D^uo^tix) = Du{x) - t [D^H{x, Du{x)) + D'^u{x) DpH{x, Du{x))] + o{t). 
By substitution, we obtain the following identity on T^: 

ut,t = u- tH{x, Du) + - {DpH{x, Du), D^H{x, Du)) 

-t{G{x,Du) -t{DpG{x,Du), D^H{x,Du) + uDpH{x,Du))) 

+ - {DpG{x, Du), D^G{x, Du)) + o{f), 

that is, 

ut^f = u - t {H{x,Du) +G{x,Du)) + {DpG{x,Du), D"^ uDpH{x,Du)) 

+ - {{DpH{x, Du), D^H{x, Du)) + {DpG{x, Du), D^G{x, Du))) 

+ {DpG{x,Du), D^H{x,Du)) +o{t^). 

We now make the symmetrical computation for and we subtract to get 

ut,t-u^'^ = t^{{DpG{x,Du), D^H(x,Du)) - {DpH{x,Du), D^G{x,Du))) +o(t^). 

The left-hand side term is by the commutation hypothesis, so the assertion follows 
by letting t Q and by exploiting the fact that u, and hence Du, is arbitrary. □ 
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